 |
Haoran Xie, Ph.D.
|
 
|
xie at jaist.ac.jp ]
Latest News
- 2024.08 JAIST-NSF-IRES Physical AI International Workshop 2024 will be held in JAIST.
- 2024.06 will serve as Conference Chair of NICOGRAPH International 2025. Welcome to visit Kanazawa and JAIST!
- 2024.01 will serve as program committee of CGI2024, CASA2024, Cyberworlds2024, NICOINT2024, IEVC2024.
- 2024.01 Our recent projects have been accepted in IEEE Access 2024, ICRA2024, IUI2024, IWAIT2024, CGIP2024, HCII2024.
- 2023.10 will serve as the Educator's Forum Chair of ACM SIGGRAPH ASIA 2024.
- 2023.08 Our AniFaceDrawing project has been reported by various medias: [ACM Technews] [TechXplore] [EurekAlert!] [alphagalileo] [JAIST] [Waseda] [ScienceDaily] [News8Plus] [日本の研究] [SINA] [QQ] [北陸放送] [北國新聞] [PC Watch] [CGWORLD]
- 2022.11 3-years-NSF-Project Physical AI Design (PI: Prof.Bo Zhu) has been launched. Please check project webpage here.
Short Bio
-
H. Xie is an Associate Professor at Japan Advanced Institute of Science and Technology (JAIST)
from April 2023. He was Assistant Professor (2018), Senior Lecturer (2020) in JAIST,
Project Assistant Professor (2017) and postdoc researcher (2015) in User Interface Research Group working with
Takeo Igarashi in University of Tokyo. Ph.D. and M.S. in Computer Graphics under the supervision of Kazunori Miyata
from JAIST (2015), B.S. in Applied Mathematics from Anhui University (2006). Visiting Kent State University (2013-2014) working with Ye Zhao, University of Sydney (2011), University of California Davis (2012).
Members of ACM, IEEE, IPSJ, Society for Art and Science. His researches have been reported by many medias including Daily Industrial News, ITmedia NEWS, TechXplore, China Science Daily.
[NSF IRES: Summer Research Intern Opportunity]: From 2022 Fall, we started to direct a three-year research project on Physical AI Design sponsored by NSF with Prof.Bo Zhu (PI) and Prof. Takeo Igarashi. We are actively looking for summer research interns in the areas of physics simulation, machine learning, and user interface in Dartmouth College, University of Tokyo and JAIST. More information about the internship can be found on the project webpage. (The applicant must be a U.S. citizen or permanent resident)
Research Vision
- Human-Centered Generative AI (Degrees of Information Science):
- 2D Image Generation: sketch-to-image, text-to-image, image-to-image, etc.
- 3D Model Generation: sketch-to-3D, neural field, text-to-3D, SDFs, NeRF, etc.
- Dynamics Generation: sketch-to-dynamics, fluid simulation, character animation, etc.
- Design/Drawing Assistance: user guidance, drawing interface, generative models, etc.
- Augmented Human and Beyond (Degrees of Knowledge Science):
- Supernumerary Robotic Limbs: robotic arm, soft robotic, shape-changing interface, wearable devices, etc.
- Spatial Computing for Human Augmentation: creativity support, digital fabrication, training and sports,etc.
- Human-in-the-Loop User Interfaces: active learning, video retrieval, machine learning, etc.
Our group provides the education of both Information Science and Knowledge Science degrees for self-motivated PhD/Master students. We explore innovative research projects in Interactive Computer Graphics, Deep Learning, Image Generation, Human-Computer Interaction, Human Augmentation and Robotics with the following current main research topics: (For research introduction, please refer [JAIST][Sketch]．)
Selected Research Projects (For more details, please refer to page Publications and Videos.)
| Human-Centered Generative AI + Image Generation | ||
(GenAI4Architecture, Frontiers of Architectural Research 2024)
[PDF] |
(TexControl, NICOINT 2024)[PDF](Best Paper Award) |
|
(T2I Spatial Control, CGIP 2024)[PDF](Best Presentation Award) |
(DiffFaceSketch, IEEE Access 2024)[Project][PDF] |
(AniFaceDrawing, SIGGRAPH 2023)[Project][PDF][Video] |
(DualFace, CVM 2021)[Project][Code] [PDF][Video] [Talk][CVM] |
(Sketch2AnimeHair, NICOINT2021)[Project][Video][IEEE](Best Paper Nomin) |
(Sketch2Normal, IWAIT2021)[PDF][Arxiv] [SPIE] |
Human-Centered Generative AI + Model Generation |
(DualShape, IEEE Access 2024)[Video][PDF] |
(Sketch2Cloth, NICOINT 2023)[Video][PDF] |
Human-Centered Generative AI + Dynamics Generation |
(DiffSmoke, 2024)[Video](coming) |
(DualSmoke, CVMJ 2024)[Code] [PDF][Video] |
|
(DualMotion, IEICE 2022)[Video] [PDF] |
(Sketch2VF, CASA2019, CAVW2019)[Project][Video] [PDF](Best Paper Nomin) |
(Sketch2Motion, NICOINT2021)[Youtube][IEEE] |
Human-Centered Generative AI + Augmented Human |
|
(AniFaceDrawing, SIGGRAPH 2023) [Project][PDF][Video] |
(DualSlide, NICOINT 2023)[PDF][Video] |
(DualFace, CVM2021) [Project][Code] [PDF][Video] [Talk][CVM] |
Augmented Human + Wearable Computing |
(Origami SRL, IEEE Access 2024)[Youtube][Youtube(short)][IEEE] |
(OrigamiBot, AsianCHI 2023)[Youtube][AsianCHI][SII] |
(AugLimb, AH 2022)[Project][Video][NEWS][PDF] |
(xLimb, AH 2021)[Project][Video][NEWS][ACM](Best Short) |
(xBalloon, AH 2021)[Project][Youtube] [ACM] |
(NaviChoker, AH 2021)[Project][Youtube] [ACM] |
(EgoSpace, AHs 2020)[Project][Video] [ACM](Best Presentation) |
(xClothes, AH 2020)[Project][Video][ACM](Best Paper Award) |
(RESTAIL, AH 2019)[Project][Youtube] [News][TV] [ACM] |
Augmented Human + Spatial Computing |
(MultiBrush, ICVR 2023)[Youtube][IEEE](Excellent Oral Pres.) |
(Sketch2Makizushi, NICOINT 2022)[Video][IEEE](Best Presentation Award) |
(Sketch2Bento, NICOINT 2021)[Youtube] [IEEE](Best Poster) |
(BalloonFAB, CHI 2019-LBW)[Project][Youtube] [ACM] |
(NewspaperFab, NICOINT 2021)[Youtube] [IEEE] |
(FreeDance, NICOINT 2021)[Youtube] [IEEE] |
(CalliShadow, NICOINT 2020)[Youtube] [IEEE](Best Presentation) |
(CoreTraining, NICOINT 2019)[Youtube][IEEE] [PPT] |
(Sketch2Domino, NICOINT 2020)[Project][Youtube] [IEEE](Best Paper) |
Augmented Human + Human Perception |
(SpaceEditing, IUI 2024)[PDF][Youtube] |
(SGDraw, HCII 2023)[PDF][Youtube] |
(Skel2Stroke, SIGGRAPHAsia21-short)[ACM][Video][IEEE](Best Poster) |
(GuideDNN, IUI 2023)[Project][PDF] [Video][Code] |
(HiVideo, SIGGRAPH 2022 Poster)[Project][Youtube][Code][PDF] |
(FontManifold, NICOINT 2019)[Youtube][IEEE] [PPT] |
(Body2Particles, ICEC 2020)[Project][Youtube] [Springer] |
(Selfie, IUI 2018-ws)[Project][PDF] [Youtube] |
Others (Physics Simulations, Data-Driven Simulations, Robotics) |
(PanelAD, ACM SIGGRAPH, TOG 18)[Project][Youtube] [ACM] |
(Light Rigid, Visual Computer 14)[Project][Springer] [Youtube] |
(Stochastic, SIGGRAPHAsia13-brief)[Project][ACM] [Youtube] |
(Pattern Guided, MIG 15)[Project][Youtube][PPT] [ACM] |
(BPActuators, RoboSoft 2021)[IEEE][Arxiv][Youtube][News] |
(Robot Drawing, 2016)[PDF][Youtube] |
Profile
- Associate Professor@JAIST, 2023.04 - current
- Senior Lecturer@JAIST, 2020.10 - 2023.03
- Assistant Professor@JAIST, 2018.04 - 2020.09
- Project Assistant Professor@University of Tokyo, 2017.04 - 2018.03
- Postdoc Researcher@University of Tokyo, 2016.04 - 2017.03
- JSPS Research Fellow (PD)@University of Tokyo, 2015.04 - 2016.03
- Ph.D. (Computer Graphics)@JAIST, 2012.04 - 2015.03
- JSPS Research Fellow (DC2)@JAIST, 2014.04 - 2015.03
- Visiting Scholar@Kent State University, (2013)
- M.S. (Computer Graphics)@JAIST, 2010.04 - 2012.03
- Visiting Scholar@The University of Sydney, Australia, (2011)
- Research Student(Computer Graphics)@JAIST, 2009.10 - 2010.03
- System Engineer, Project Leader@USTC EBT, 2006.07 - 2009.09
- B.S. (Applied Mathematics)@Anhui University, 2002.09 - 2006.06
Contact
| Tel: | +81-0761-51-1721 |
|---|---|
| Address: | 1-1 Asahidai, Nomi, Ishikawa, 923-1211, Japan |
| Mail: | xie@jaist.ac.jp |